A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique
نویسندگان
چکیده
Creativity Research Journal Publication details, including instructions for authors and subscription information: http://www.informaworld.com/smpp/title~content=t775653635 A Comparison of Expert and Nonexpert Raters Using the Consensual Assessment Technique James C. Kaufman a; John Baer b; Jason C. Cole c; Janel D. Sexton* d a Learning Research Institute California State University, San Bernardino b Rider University, c Consulting Measurement Group and Quality Metric, d California State University, San Bernardino
منابع مشابه
Inter-rater and intra-rater reliability in the interpretation of MTI Photoscreener photographs of Native American preschool children.
PURPOSE To evaluate inter- and intra-rater reliability for the interpretation of MTI Photoscreener photographs taken in a population of Native American preschool children with a high prevalence of astigmatism. METHODS Photographs of 369 children were rated by 11 nonexpert and 3 expert raters. Photographs for each child were scored as pass, refer, or retake. Nonexpert raters scored photos on t...
متن کاملExploring Novice Raters’ Textual Considerations in Independent and Negotiated Ratings
Educators often employ various training techniques to reduce raters’ subjectivity. Negotiation is a technique which can assist novice raters to co-construct a shared understanding of the writing assessment when rating collaboratively. There is little research, however, on rating behaviors of novice raters while employing negotiation techniques and the effect of negotiation on their understandin...
متن کاملRaters’ Perception and Expertise in Evaluating Second Language Compositions
The consideration of rater training is very important in construct validation of a writing test because it is through training that raters are adapted to the use of students’ writing ability instead of their own criteria for assessing compositions (Charney, 1984). However, although training has been discussed in the literature of writing assessment, there is little research regarding raters’ pe...
متن کاملAssessing Creativity Using the Consensual Assessment Technique
AbstrAct The Consensual Assessment Technique is a powerful tool used by creativity researchers in which panels of expert judges are asked to rate the creativity of creative products such as stories, collages, poems, and other artifacts. Experts in the domain in question serve as judges; thus, for a study of creativity using stories and poems, a panel of writers and/or teachers of creative writi...
متن کاملScore Generalizability of Writing Assessment: the Effect of Rater’s Gender
The score reliability of language performance tests has attracted increasing interest. Classical Test Theory cannot examine multiple sources of measurement error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple factors contributing to the total variance of measurement. Generalizability theory by using analysis of variance ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008